Introduction
How About Some Revalidation Spotify? Comparing the decent and recovery of John Frusciante through music.
John Frusciante is American musician best known as the guitarist of The Red Hot Chili Peppers (RHCP). Besides his work for the RHCP, he has had an accomplished and diverse solo career. In 1992 he left RHCP for the first time and released his debut solo album two years later, in November 1994. The album consists of two parts: Niandra LaDes and Usually Just A T-Shirt. Niandra LaDes was mostly recorded during the writing and recorded of RHCP album Blood Surgar Sex Magic, only “Running Away With You” was recorded after quitting the band. Usually Just A T-Shirt was recorded while the band was on tour in the months leading up to Frusciante’s departure and it appears in the order it was recorded. It was during these months that his use of cocaine and heroin became more extreme. Frusciante said himself in an interview that he can hear his decline into hard drugs in the songs: “It’s very sad because I hear, when I listen to it [the last two songs on the record], that it sounds like a person falling apart or it sounds like somebody about to kill themselves”. It wasn’t until January 1998 that Frusciante was admitted to rehab. He checked out and re-entered society about a month later. The same year Frusciante rejoined RHCP, released a new album with them and went on tour. During the tour he composed new material for his first solo record after rehabilitation, To Record Only Water For Ten Days. What I would like to research in this corpus, is what Spotify’s API can tell us about the differences in his album before rehabilitation, Niandra Lades and Usually Just A T-Shirt (NLDAUJATS), and after rehabilitation, To Record Only Water For Ten Days (TROWFTD). I will compare the two albums mostly by comparing the Spotify features: speechiness (spoken word detection), valence (musical positiveness), energy (a perceptual measure of intensity and activity), loudness (the overall loudness of a track in decibels) and danceability (danceability describes how suitable a track is for dancing based on a combination of musical elements including tempo, rhythm stability, beat strength, and overall regularity).
The Album Covers
Comparing both albums
Scatterplot
This scatter plot shows the energy vs valence of all songs from both albums. The size represents the speechiness (the detection of spoken words in a track) and the colour represents the loudness (overall loudness of a track in dB). I think this graph does a great job of showing the overall difference between the two albums. For example, the smooth line shows that the lowest energy level of TROWFTD seamlessly picks up from where NLDAUJATS left it and continues to raise the bar. Most of the songs on NLDAUJATS are also generally more clustered around the bottom left corner, meaning they are low on energy and valence, while most of the songs on TROWFTD are clustered around the top in the middle and on the right, showing that are way higher in energy levels and ‘positivity’. Both the speech and loudness levels are also clearly higher on TROWFTD. The loudest song on NLDAUJATS (‘Big Takeover’) for example, is nearly four times quieter than the loudest song on TROWFTD (‘Fallout’). Something I don’t understand however, is that the song ‘Skin Blues’ has the highest speech levels on NLDAUJATS. ‘Skin Blues’ has no vocals on it or any speech as far as I can hear, so what does Spotify analyze that sounds to it like spoken words?
Bar Chart of Vitality
On the left we have two bar charts, one measuring the valence and one measuring the energy on the two albums. As one would predict after listening to the albums, To Record Only Water For Ten Days beats Niandra Lades and Usually Just A T-Shirt on both accounts, especially in energy. What I find interesting, is that Niandra Lades and Usually Just A T-Shirt has 10 more songs than To Record Only Water For Ten Days, but still loses the fight. This shows how much more energetic and positive Spotify (and I can’t help but agree) finds the latter album.
Histogram of Tempo Differences
Comparing the Keys
| Key | Track | Album |
|---|---|---|
| A major | Untitled #7 | Niandra LaDes And Usually Just A T-Shirt |
| A major | Moments Have You | To Record Only Water For Ten Days (U.S. Version) |
| A minor | My Smile Is A Rifle | Niandra LaDes And Usually Just A T-Shirt |
| A minor | Untitled #5 | Niandra LaDes And Usually Just A T-Shirt |
| A minor | Untitled #11 | Niandra LaDes And Usually Just A T-Shirt |
| A minor | Untitled #12 | Niandra LaDes And Usually Just A T-Shirt |
| A minor | Invisible Movement | To Record Only Water For Ten Days (U.S. Version) |
| A minor | In Rime | To Record Only Water For Ten Days (U.S. Version) |
| A minor | Saturation | To Record Only Water For Ten Days (U.S. Version) |
| A# minor | Ramparts | To Record Only Water For Ten Days (U.S. Version) |
| B major | Untitled #1 | Niandra LaDes And Usually Just A T-Shirt |
| B major | Untitled #6 | Niandra LaDes And Usually Just A T-Shirt |
| B minor | As Can Be | Niandra LaDes And Usually Just A T-Shirt |
| B minor | Running Away Into You | Niandra LaDes And Usually Just A T-Shirt |
| B minor | Away & Anywhere | To Record Only Water For Ten Days (U.S. Version) |
| B minor | Remain | To Record Only Water For Ten Days (U.S. Version) |
| B minor | Representing | To Record Only Water For Ten Days (U.S. Version) |
| C major | Untitled #3 | Niandra LaDes And Usually Just A T-Shirt |
| D minor | Head (Beach Arab) | Niandra LaDes And Usually Just A T-Shirt |
| D minor | Been Insane | Niandra LaDes And Usually Just A T-Shirt |
| D minor | Your Pussy’s Glued To A Building On Fire | Niandra LaDes And Usually Just A T-Shirt |
| D minor | Wind up Space | To Record Only Water For Ten Days (U.S. Version) |
| D minor | Fallout | To Record Only Water For Ten Days (U.S. Version) |
| D# major | The First Season | To Record Only Water For Ten Days (U.S. Version) |
| D# minor | Untitled #8 | Niandra LaDes And Usually Just A T-Shirt |
| D# minor | Untitled #10 | Niandra LaDes And Usually Just A T-Shirt |
| E minor | Skin Blues | Niandra LaDes And Usually Just A T-Shirt |
| E minor | Blood On My Neck From Success | Niandra LaDes And Usually Just A T-Shirt |
| F major | Curtains | Niandra LaDes And Usually Just A T-Shirt |
| F major | Untitled #2 | Niandra LaDes And Usually Just A T-Shirt |
| F major | Someone’s | To Record Only Water For Ten Days (U.S. Version) |
| F# major | Ten To Butter Blood Voodoo | Niandra LaDes And Usually Just A T-Shirt |
| F# minor | With No One | To Record Only Water For Ten Days (U.S. Version) |
| F# minor | Murderers | To Record Only Water For Ten Days (U.S. Version) |
| G major | Untitled #4 | Niandra LaDes And Usually Just A T-Shirt |
| G minor | Going Inside | To Record Only Water For Ten Days (U.S. Version) |
| G# minor | Big Takeover | Niandra LaDes And Usually Just A T-Shirt |
| G# minor | Mascara | Niandra LaDes And Usually Just A T-Shirt |
| G# minor | Untitled #9 | Niandra LaDes And Usually Just A T-Shirt |
| G# minor | Untitled #13 | Niandra LaDes And Usually Just A T-Shirt |
Here we have a histogram comparing the keys used in the two albums. It seems Frusciante had a preference for writing songs in A, B, D(major) and G#. B and G# are both close to A, by a whole note and a half note respectively. This could suggest that his vocal range fits best when singing in these keys, or maybe he just has a preference for the sound of them. However there are no songs in G# in TROWFTD. This could be because of (sometimes what seems unintentional) instances of chromatic music in NLDAUJATS, resulting in some songs that might intentionally be in A, being read as G# by Spotify. Frusciante also has a preference for minor with 29 songs in minor key and 11 in major key. NLDAUJATS has 17 songs in minor and 8 in major, and TROWFTD has 12 songs in minor and 3 songs in major.
Classifiers: using a k-Nearest Neighbour, Decision Tree and Random Forest classifier to predict which song belongs to the album it’s from.
# A tibble: 4 x 7
id .pred_NLDAUJATS .pred_TROWFTD .row .pred_class playlist .config
<chr> <dbl> <dbl> <int> <fct> <fct> <chr>
1 Fold1 0.108 0.892 4 TROWFTD NLDAUJATS Preprocessor1…
2 Fold2 0.531 0.469 33 NLDAUJATS TROWFTD Preprocessor1…
3 Fold3 0.937 0.0634 39 NLDAUJATS TROWFTD Preprocessor1…
4 Fold5 0.541 0.459 28 NLDAUJATS TROWFTD Preprocessor1…The last classifier I’m using is the random forest classifier. As you can see it perfomed the best out of the three, getting only one prediction wrong for both albums.
Comparing songs
The Chosen (s)On(g)e’s: zooming in on two songs, from both albums, with relatively average valence and energy levels
I have chosen the songs “Running Away Into You” from NLDAUJATS and “Going Inside” from TROWFTD because I think they are good representations for the positiveness (valence) and energy of their given album and time period. Zooming in on these tracks will hopefully give new insights on the differences between the two radically different periods in which the songs were recorded.
“Running Away Into You” has a mean valence and energy of 0,2120 and 0,25400 respectively, with a mean valence and energy of 0,2414 and 0,30840 respectively for NLDAUJATS.
“Going Inside” has a mean valence and energy of 0.5840 and 0.81600 respectively, with a mean valence and energy of 0.4666 and 0.7543 respectively for TROWFTD.
Song clips
Chromograms
First of all a track-level analysis with chromagrams. The chromagrams already show us some relevant differences between the tracks.
“Running Away With You” seems to have more distinction between notes than “Going Inside”, but there are more clustered segments of two or three notes that are only a half step each away from each other: C#/Db and D, A, A#/Bb and B (around the 75s mark), and F#/Gb and G from 100s onward. “Going Inside” has less spaces with low magnitude, but there’s more distinction in the notes of Gm, the key the song is in.
“Going Inside” clearly has more consonance than “Running Away Into You”, which results in it sounding more pleasant and acceptable to the ear. The harshness and dissonance of “Running Away Into You” could be seen as a reflection of someone in an unstable period, e.g. a desent into hard drugs. “Going Inside” sounds much more structured and stable. The main reason for this is the drum machine being used in TROWFTD, but the harmonies and tones are also a lot more clear and bright than in NLDAUJATS.
These chromagrams visualize the lack of structure Frusciante’s music had in his descent and the refound structure in his music made after revalidation.
Self-Similarity Matrix
Tempogram
Here’s where things get very clear. The tempogram of “Running Away Into You” is all over the place. There’s no clear bpm to find and in the last few seconds Spotify reads multiple tempo’s at the same time, all what seems to be equally distanced apart. This is due to the delay feedback at the end of the track, being sped and slowed down. The tempo of “Going Inside” is self-measured by the tempogram at around the 200/400 bpm mark. The tempo Spotify measures is 104.1 bpm. The reason for this difference is the tempogram basing the bpm on energy, and therefor doubling and quadrupling the original bpm by including the 8th and 16th notes in it’s measurement. Spotify bases the tempo on the average beat duration, smartly choosing the quarter notes of the 4/4 time signature the song is in.
This however, is not a fair comparison. As steated earlier, “Going Inside” has a drum machine making the job a lot easier for the tempogram. This is why I have included a third tempogram for the song “Saturation” on TROWFTD, one of only two songs that doesn’t make use of a drum machine. I chose this song not only for the lack of a constant tempo, but also for the similar playing style of alternating between strumming and picking chords.
As you can see, TROWFTD remains triumphant in maintaining a (somewhat) stable tempo. The tempogram once again doubles and very occasionally quadruples the original bpm of 92.3, but coincidentally like “Running Away Into You” does something strange at the last part of the song. This time it resembles a DNA helix, caused by the overpowering synthesizer being played.